πŸ“š node [[hidden_layer|hidden layer]]
Welcome! Nobody has contributed anything to 'hidden_layer|hidden layer' yet. You can:
  • Write something in the document below!
    • There is at least one public document in every node in the Agora. Whatever you write in it will be integrated and made available for the next visitor to read and edit.
  • Write to the Agora from social media.
    • If you follow Agora bot on a supported platform and include the wikilink [[hidden_layer|hidden layer]] in a post, the Agora will link it here and optionally integrate your writing.
  • Sign up as a full Agora user.
    • As a full user you will be able to contribute your personal notes and resources directly to this knowledge commons. Some setup required :)
β₯… related node [[hidden layers]]
β₯… related node [[hidden_layer]]
β₯… node [[hidden-layers]] pulled by Agora

Hidden Layers

Go to [[Week 2 - Introduction]] or back to the [[Main AI Page]] Part of the page on [[Deep Learning]]

Hidden layers are layers of neurons between the input and output layers that allow the neural network to identify features in the input.

But ...

If a network includes too many neurons in a hidden layer, it can overfit and simply memorize the input patterns, which limits the network’s ability to generalize. Too few neurons in the hidden layer can result in the network being unable to represent the input-space features and also limit the networks’ ability to generalize. In general, the smaller the network (fewer neurons and weights), the better the network.

A graphical representation of a hidden layer

β₯… node [[hidden_layer]] pulled by Agora

hidden layer

Go back to the [[AI Glossary]]

A synthetic layer in a neural network between the input layer (that is, the features) and the output layer (the prediction). Hidden layers typically contain an activation function (such as ReLU) for training. A deep neural network contains more than one hidden layer.

πŸ“– stoas
β₯± context